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1 Introduction 

A (homogeneous) polynomial chaos of order d is a random variable defined 



as 



/ ^ (^ii,—,id^il'''^idy {^) 

where Xi, . . . ,X„ is a sequence of independent real random variables and 
('^ji,...,jd)i<n,...,jd<n is a d-indexed symmetric array of real numbers, satisfying 
(^ii,...,id — whenever there exists k ^ I such that i^ = ii- 

Random variables of this type appear in many branches of modern prob- 
ability, e.g. as approximations of multiple stochastic integrals, elements of 
Fourier expansions in harmonic analysis on the discrete cube (when the un- 
derlying variables Xj's are independent Rademachers) , in subgraph counting 
problems for random graphs (in this case Xj's are zero-one random variables) 
or in statistical physics. 

Chaoses of order one are just linear combinations of independent ran- 
dom variables and their behavior is well-understood. Chaoses of higher or- 
ders behave in a more complex way as the summands in ([T]) are no longer 
independent. Nevertheless, due to their simple algebraic structure, many 
counterparts of classical results for sums of independent random variables 
are available. Among well known results there are Khinchine type inequal- 
ities and tail bounds involving the variance or some suprema of empirical 
processes (see e.g. [TCI HDl El El S] or Chapter 3 of [B]). 

In several cases, under additional assumptions on the distribution of Xj's, 
even more precise results are known, which give two sided estimates on mo- 
ments of polynomial chaoses in terms of deterministic quantities involving 
only the coefficients aii,...,irf (the estimates are accurate up to a constant de- 
pending only on d). Examples include Gaussian chaoses of arbitrary order 
[13], chaoses generated by nonnegative random variables with log-concave 
tails [Hy and chaoses of order at most two, generated by symmeric radom 
variables with log-concave tail ([9] for d = 1 and [12] for d = 2). 

The aim of this paper is to provide some extensions of these results. In 
particular we provide two sided estimates for moments of chaoses of order 
three generated by symmetric random variables with log-concave tails (Theo- 
rems [XT] and (221) and for chaoses of arbitrary order, generated by symmetric 
exponential variables (Theorem 13. 4p . 



Before we formulate precisely our main results let us recall the notion of 
decoupled chaos and decoupling inequalities. A decoupled chaos of order d 
is a random variable of the form 






d 



(2) 



where (aii,...,irf)i<ii,...,j^<n is a d-indexed array of real numbers and X', i = 
1, . . . ,n, I = 1, . . . ,d, are independent random variables. 

One can easily see that each decoupled chaos can be represented in the 
form (II]) with a modified matrix and for suitably larger n. However it turns 
out that for the purpose of estimating tails or moments of chaoses it is enough 
to consider decoupled chaoses. More precisely, we have the following impor- 
tant result due to de la Pena and Montgomery-Smith [^. 

Theorem 1.1. Let (aj^^...^j^)i<ji^...^i^<„ be a symmetric d-indexed array such 
that ai^^,,,^i^ = whenever there exists k ^ I such that ik = k- Let Xi, . . . , X^ 



he independent random variables and (X/)i<i<„, j = \ 
copies of the sequence (Xj)i<j<„. Then for all t > 0, 



, d, be independent 



> LA 



> t 



h,...,id=l 
n 

il,...,id=l 
n 

h,...,id=l 

where L^ G (0, oo) depends only on d. In particular, for all p>l, 

n n 

II . -, p II . ^-^ _, 



ii,...,id=l 

where L^ depends only on d. 



If we are not interested in the values of numerical constants, the above 
theorem reduces estimation of tails and moments of general chaoses of order 
d to decoupled chaoses. The importance of this result stems from the fact 
that the latter can be treated conditionally as chaoses of smaller order, which 
allows for induction with respect to d. Since the reduction is straightforward, 
in the sequel when formulating our results we will restrict to the decoupled 
case. 

Let us finish the introduction by remarking that two-sided bounds on 
moments of chaoses of the form ([1]) can be used to give two-sided estimates for 
more general random variables, i.e. tetrahedral polynomials in Xi, . . . ,Xd, 
e.g. to polynomials in which every variable appears in a power at most 
1. This is thanks to the following simple observation, which to our best 
knowledge has remained unnoticed. 

Proposition 1.2. For j = 0,1,..., c? let (a]^ i-)i<ii,...,ij<n be a k-indexed 
symmetric array of real numbers (or more generally elements of some normed 
space), such that a\_^ ...i — ^ ^f ^k = k for some I < k < I < j (for j = 
we have just a single number a^). Let Xi, . . . , Xn be independent mean zero 
random variables. Then there exists a constant Ld e (0, cxd), depending only 
on d, such that for all p > 1, 



d 

1. 


n 


.,.^n ■ 


■■X, 


d n 

,<i. >: >: <.. 


.,ij^il ■ 


■■X, 


j=0 


ii,...,tj=i 






3=0 h,...,ij=l 







Note that a reverse inequality boils down just to the triangle inequality 
in Lp and so the above proposition immediately gives two-sided estimates of 
moments of tetrahedral polynomials from estimates for homogeneous chaoses. 
Since the details are straightforward we will not state explicitly the results 
which can be obtained from the inequalities we present. The easy (given 
general results on decoupling) but notationally involved proof of Proposition 
11.21 is deferred to the appendix. 

The organization of the article is as follows. After introducing the nec- 
essary notation (Section |2]) we state our main results (Section [3]) and devote 
the rest of the paper to their quite involved proof. In the course of the proof 
we provide entropy estimates for special kinds of metrics on subsets of certain 
product sets (Section 15. 2p as well as bounds on empirical processes indexed 
by such sets (Section [6] and Section [7] where we also provide some partition 
theorems). We believe that these results may be of independent interest. 



In Section |S] we conclude the proof of our result for chaoses of order three 
and in Section M we give a proof of estimates for chaoses of arbitrary order 
generated by exponential variables. 

2 Definitions and notation 

Let {Xi)i<i<n,i<j<d be a matrix of independent symmetric random variables 
with logarithmically concave tails, i.e. such that the functions N^ : [0, oo) 
—7- [0, oo] defined by 

iV/(t) = -lnP(|Xf|>t) 

are convex. We assume that r.v.'s are normalized in such a way that 

inf{t>0: A/'/(t) > 1} = 1. (3) 

We set 

I N'^i\t\) for |t| > 1. 

Remark When working with d = 1 we will suppress the upper index j and 
write simply Xj or Ni. 

Recall that the p-th moment of a real random variable X is defined as 
\\X\\P = E\X\P. 

For i G {1, . . . , n}'^ and / C {1, . . . , rf} we write i/ = {ik)kei- By Pd we 
will denote the family of all partitions of {1, . . . , d} into nonempty, pairwise 
disjoint subsets. For J = {/i, . . . , Ik} G Pd, p > 2 and a multiindexed matrix 
(tti) we define 

ii(«i)iH 

siG7i,...,Sfee/fe i 1=1 isi 

Remark When Ii is a singletone, i.e. Ii = {si}, then for any fixed value of 



In particular for d = 3 we have 



{^ijk)\\{l,2,3},p 



: sup I ^ a^jkXijk ■■ ^Nl( J2 ^%k )-A 

^ ijk i y j,k ^ ^ 

+ sup I ^ a^jkXijk ■■ ^^[ E ^%k )-A 

^ ijk j ^ y i,k ' 

+ sup I ^ aij^x,^^, ■ J] Nl iJj2 ^Ikj < p| > 



ijk k ^ y i,j 



(«ijfc)||{l,2}{3},p 



sup <^ ^ aijkXijVk : Xl ^/f , Yl 4 ) - P'Yl ^kiVk) < P \ 
^ ijk « ^y i ^ k ^ 

+ sup I ^ aijkXijVk ■■ J2^H JYI 4- ) -P^Yl ^k iVk) <p\ 



ijk 

and 

ll('^Jifc)ll{l}{2}{3},p 

= sup I ^ aijkXiVjZk : ^ Nl{xi) < P, ^ N'^i.Vj) <P^Y Nl{zk) < pj. 

ijk ijk 

Throughout the article we will write L^, L to denote constants depending 
only on d and universal constants respectively. In all cases the values of a 
constant may differ at each occurence. 

By A r^d B we mean that there exists a constant Ld G (0, oo), such that 
L^^B <A< LdB. 

We will also denote X^ = (Xj^)i<j<„ and write Ej for the expectation 
with respect to X^ . 

3 Main results 

Theorem 3.1. For any d > 1 and p >2 we have 

\\J2^-^K---K >f Eii(«i)iil- (4) 

II ■^^ p Li A ■^■"^ 

i JePd 



Theorem 3.2. For d <3 and p > 2, 

II ■^■"^ p •^■"^ 

i J^ePd 

Remark 1. Let X^! = cgj, where gl are i.i.d. Af{0, 1) r.v's. and 1 < c < 10/9 
is such constant that normalization (^ holds. Then t'^/L < Nl{t) < Lt^ and 
for J={Ji,...,4}GP,,p>2 



«iJH>,p~dP ' \\[ai)\\j, 



where 

||(ai)b = sup { J^ai n< : ll< lb < 1, 1 < / < k}. 

i i=l 

Theorems 13. II and 13.21 (for arbitrary d) in this case were established in [13j . 

A standard application of the Paley-Zygmund inequality (see e.g. Corol- 
lary 3.3.2. of [6]) and the fact that p-th and 2p-th moments of chaoses 
generated by random variables with log-concave tails are comparable up to 
constants depending only on the order of the chaos yield the following corol- 
lary (for details see the proof of Corollary 1 in |13j). 

Corollary 3.3. For d < 3 and t > 0, 



L 



l-e-^/^^<F(\j2aiXl---K\ > E \\(^-^)\\j,t) < L.e-'"^' 



J&Pd 



We are not able to show Theorem 13.21 for rf > 3 in the general case. 
However we know that it holds for exponential random variables. 

Theorem 3.4. // N^{t) = t for all i,j and t > then for any d and p > 2 

the estimate (15]) holds. 



4 Proof of Theorem 13.1 



We will proceed by induction with respect to d. The case d = 1 was proved 
in [9]. Let us therefore assume the theorem for all positive integers smaller 
than d > 1. 



Note that since we allow the constants to depend on d, it is enough to 
show that the left-hand side of (jl]) is niinorized by each of the summands on 
the right-hand side. 

For any J' = {/i, . . . ,1^} G Pd, with k > 2, the induction assumption 
applied conditionally on (X-^)jg/^ gives 



J2^^K---K 



> 



L 



d-#h 



E, 



ill ''^-^1 



Af' N p^ 1/p 



where M' = {N^)i<i<n,jeq- 

Let us fix arbitrary Si G /i, . . . , s^ G /fc. We have 



/ LtC 



A/-' Y 

J\h,py 



ijc ijj^ rG/i 1=2 



1/; ■ 



' ^-a;t^)i,,,,,||2)<P,2</<A:})' 



i '" ' .jj- 



(6) 






i 1=1 



where the last inequality follows from another application of the induction 
assumption, this time to a chaos of order ^Ii. Since the indices si, . . . ,Sd 
run over sets of cardinality not exceeding d, the above estimate together with 
([6]) imply that 



1 



llA^ 



i 

The case k = 1 requires a different approach. Again it is enough to show 






that for each I G {1, . . . ,d}, 



1/2n 



Consider any Xj such that ^^ ^i;((X]i c x'^Y'^) < p. By the symmetry of 
Xi we have 



i ii i{;}c AiT^i 

>Ej5^A-;,E,„.|5^a,n-f.'I 






1/2 IP 



!{(}'= 






«i MO'^ 






^d ' 



1 I >r^ IP 

— Tp / ^ OjXi , 



i{0= 



where the first inequahty follows from Jensen's inequality, the second one 
from hypercontractivity of chaoses generated by log-concave random vari- 
ables combined with the contraction principle and the third one from the 
induction assumption. 



5 Preliminary facts 



In this section we present the basic notation and tools to be used in the proof 
of our main results. 



5.1 Some additional notation 

1. By 7„ t we will denote the distribution of tG„, where Gn = {gi, ■ 
is the standard Gaussian vector in M". 



■,9n 



9 



2. By Un^t "we will denote the distribution of tSn, where Sn = (■Ci? • • • ,Cn) 
is a random vector in R" with independent coordinates distributed 
according to the symmetric exponential distribution with parameter 1. 
Thus h'n,t has the density 



1 ™ 
ciz/„,t(a:) = (2t)-"exp(--5^ 



n 

iXy 7' I ( HlJb • 



We also put £1^ = {^l, . . . , ^^) for i.i.d. copies of £n- 
Let us note that E^f = 2. 

3. For any norm a on M"'i'""d = ]^n-i ^ . . . ^ /^"-d (which we will identify 
with the space of cZ-indexed matrices), let p^ be the distance on M^i x 
■ ■ ■ X M"'^ , defined by 

Pq(x, y) = a{xi ® ■ ■ ■ O Xrf - yi O ■ ■ ■ (g) i/rf), 

where x = (xi, . . . , x^), y = (t/i, . . . , t/d). 

For X G M^i+'+^d and r > let -Bq,(x, r) be the closed ball in the 
metric p^ with center x and radius r. 

4. Now, for T C M"i X ■ ■ ■ X M"^ t > 0, define 

A:=l /C{1,...,4,#/=A: 

where for / C {1, . . . , d}, 

l^f(a) = supEa((n<n^t) )• 

5. Similarly, for t > 0, T C M"^ x . . . x M"-^ we put 

k=l IC{l,...,d}: #I=k 

Vf(a):=supEa((n4n^i). 



10 



where 



6. For s,t > 0, T C M"i X . . . X M"^ we define 



Ul{a,s,t):=Y: E ^*'t*^Ul 



a 



k=l I,JC{l,...,d}, 
#(/UJ)=*;,/nJ= 



where 



^^ k^(IUJ) k&I k£j *^'"'' 

Remark Let us notice that U^j{a) = Vf{a), whereas [//'^(a) = Wj^{a). 

The quantity Wj^ was defined in [13], where it played an important role 
in the analysis of moments of Gaussian chaoses. The quantities V^ and Ujj 
will play an analogous role for chaoses generated by general random variables 
with logarithmically concave tails (as will become clear in the next section, 
they will allow us to bound the covering numbers for more general sets than 
those which were important in the Gaussian case). 

5.2 Entropy estimates 

In this section we present some general entropy estimates which will be crucial 
for bounding suprema of stochastic processes in the proof of Theorem 13.21 

The first lemma we will need is a reformulation of Lemma 1 in [13] . The 
original statement from [13] is slightly weaker however the proof given therein 
justifies the version presented below. 

Lemma 5.1. For any norms ai, 02 on M", y G B2 and t > 0, 

ln,t{x: a,{x-y)<4tEaiiGn), i = 1,2^ > ^e-^/^^''\ 
Lemma 5.2. For any norms ai, a^ on M", y G aB'^ and t > 0, 
^n,t{x: ai{x - y) < AtEaiiSn), ^ = 1,2) > V''/*. 
Proof. Let 

K := {x e W : ai{x) < 4tEai{Sn) , a2{x) < 4tEa2(^n)}. 



11 



By Chebyshev's inequality, 

1 - Jyn,t{K) < P(ai(t^n) > AEaiitSn)) + P(a2(t^n) > 4Ea2{tSn)) < 1/2. 
We get for any y G -B", 

Un,t{y + K) = (2t)~" / exp ( - - V l^i + yAdx 
Jk ^ S=i ^ 

> exp (^ - - ^ bil j / dun,t{x) 

> exp{-a/t)un,t{K) > -exp(-a/t). 

Finally, notice that if x E y + K, then ai{x — y) < 4tEaj(£^„), i = 1,2. D 

Before we formulate the next lemma, let us define /i„,s,t (where s,t > 0) 
as the convolution of '~fn,s and z/„^t. 

Lemma 5.3. For any norms ai,a2 on M", any a > 0, y E B2 + o-B" one? 
s, t > 0, /ei 

K = {x: ai{x-y)< 4sEai(G'„) + 4tEai(^„), 

a2(a:) < 4sEa2(G'„) + 4tEa2(^n) + «2(y)}. 



Then 



1 l/{2s2)~a/t 



Proof. We have y = yi + y2 for some yi G -821 ^2 G ai?". Define 

i^i = {x G M" : ai(a; - t/i) < 4sEa,(G'„), ? = 1, 2}, 
ir2 = {a;GM": a,ix - y2) < 4tEa,(^„),i = 1, 2}. 

For X = Xi + X2, where Xj G Kj, j = 1, 2, 

ai(a; - y) < ai{xi - yi) + ai(a;2 - ^2) < 4sEai(G'„) + 4tEai{Sn) 
and similarly 

a2(a;) < a2(a: - y) + a2{y) < 4sEa2(G'„) + 4tE«2(^n) + «2(l/), 

12 



therefore Ki + K2 C K. We thus have 

where in the last inequahty we used Lemmas 15.11 and 15.21 D 

Lemma 5.4. For any s,t > 0, a = {ai, . . . , ad) G (0, 00)'^ and x e (i?2^ + 
aiB'l') X ... X (B^' + ttdB"^') we have 

/i„,+...+„„,,i(5,(x,t/f^(«,4s,4t))) >4-^exp(^--rfs-'- llallit-i). (7) 

Proof. We will proceed by induction on d. For d = 1, inequality ([7]) follows 
by Lemma [5.31 Now suppose that ([7]) holds for d — 1. We will show that it 
is also satisfied for d. Let us first notice that 

a( x' - ® y') < a\x'^ - y'^) + a„d f ® x* - ® y') , (8) 

where a^ and ay are norms on M"'' and M"'^""'*-^ respectively, defined by 

a (z) := a( (8> x* z) and Q;y(-2) := a(;i; y). 

Then 

sEai(G„) + tEa\S^) = sUl^l^ia) + tf/gj}(«). (9) 

Moreover if we put 7r(x) = {x^, . . . ,x'^~^) and define a norm a^^ on M""^ by 
the formula 

then 

sEa^ (c'^) + tEa^ (£:„) + «2 (a;'^) (10) 



Y: s*H*^u\-]{a^t) 



^u'^Ua) + K{4^) 



/,JC{l,...,d} 



Notice also that by the induction assumption we have for any z G M"'', 

/x„,+...+„,_,,,t(y G M"^+-+«'*- : «.( Vx* - 'g y*) < «L,4t(2:)) (11) 

> 4i-'^exp(-(d - 1)3-72 - (ai + . . . + ad_i)t-i). 

13 



Finally let 

yl(x) := |y G M"i+-+"'' : a^x"^ - y'^) < 4sEa\Gr,,) + AtEa\Sn,), 

/ d-l . d-1 A 

ttj^d (g) x' - (g) t/M < at4i(y" 



By (H-dlOD we get A(x) C 5„(x, f/]''^(a,4s,4t)) and therefore by (|TT|), 
Lemma 15.31 and Fubini's theorem we get 

fini+...+na,s,t [Ba (^X, f/]''^ (a, 4s, 4t)^ 

> /ini+...+n,,s,t(^(x)) 

> 4^-'^ exp(-(rf - l)s"V2 - (ai + . . . + ad_i)t"^) ■ 4"^ exp(-s^V2 - Orft"^) 
= 4-'^exp(-ds"V2 - hWit'^)- 

U 

Corollary 5.5. For any T C {B^^ + aiB^^) x ... x (^2^ + a^E"'*) and 
s,tG(0,l], 

A^('T,pc.,^J(a,s,t)) < exp(Lt/s"2 + L||a||it"^). 

Proof. Obviously Uj{a, s, t) > sup^g^ Uy^ {a, s, t). Therefore by Lemma [5^ 
we have for any :x. & T, 



f^ni+...+nj_,s,t 



(B^(x,Uj{a,As,At))) > 4-'^exp(-t/s"V2 - ||a||it"^)- (12) 



Suppose that there exist xi, . . . , x^v G T such that Pai'^i, Xj) > Uj{a, s, t) > 
2Uj{a,s/2,t/2) for i ^ j. Then sets i?Q,(xj, [/J(a, s/2, t/2)) are disjoint, so 
by ([T2]) we obtain A^ < 4'^exp(32rfs-2 + 8||a||it-^). Hence 

N{T,p^,Ulj{a,s,t)) <4'^exp(32ds~^+8||a||ir^) < exp(34rfs"^+8||a||ir^). 

D 

We will need the following standard lemma, whose proof we provide for 
the sake of completeness. 
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Lemma 5.6. For any n and any norm a on M", E«(G'„) < 3Ea(£^„). 

Proof. Let g and C, be respectively standard Gaussian and symmetric ex- 
ponential random variables. For t > we have f(\g\ > t) < e~* '^ and 
P(|^| > t) = e"*. Thus for t > 2 we have P(|^| >t)< P(|^| > t). 

Consider now G„ = (f^i, . . . , f7„), £n = (.^i, . . . , (,„)■ Define moreover in- 
dependent random variables Xi, . . . ,X„ distributed as |(y'|l{|c,|>2}. Since for 
all t > 0, P(Xj > t) < IP(|^i| > t) we can assume that Xj's, (yfj's and ^j's are 
defined on the same probability space together with a sequence £i, ...,£„ of 
independent Rademacher variables, in such a way that for all i, Xj < |^j| 
pointwise, gi^s, ^j's, e^'s are independent and Xj's are independent of e^'s. 
We can write 

Ea{Gn) =Ea{ei\gi\,...,en\gn\) 

<Ea(£:i|5fi|l{|(,^|<2}, . . . ,en\gn\'^{\g„\<2}) 

+ Ea(£:i|5fi|l{|g^|>2}, . . . ,en\gn\'i-{\g„\>2}) 
<2Ea(£:i, ...,£„)+ E«(eiXi, . . . , £:„X„) 

<2E,a(eiE5iei|, . . .^Sn^ilinl) + Ea{ei\^i\, ...,en\U) 

<3E«(ei,...,e. 



^nj} 



where in the second and third inequality we used (conditionally) the contrac- 
tion principle. D 

Corollary 15.51 together with Lemma [5.61 yield 

Corollary 5.7. For any T C {B'2 + aB^'Y and any t G (0, 1], 

N{T,p^,Vj{a,t)) < exp{Ldt-^ + Laat-'). 

We would like to remark that by applying Corollary 15.51 with tjOj instead 
of ttj and letting tj tend to or infinity we can obtain similar results for 
Cartesian products of the form xf^^Ki where Ki is either B2 or QiB^. Such 
results can be also obtained directly by following the proof of Corollary 15.51 
and using Lemmas 15.11 and 15.21 instead of Lemma 15. 3[ We will need such 
entropy estimates only for d = 1 and K = aB^. This case, described in the 
next corollary, follows just from Lemma [5.21 

Corollary 5.8. For any a> 0, T C aB'^ and t G (0, 1], 

X(T,p„,tEa(f)) < 2exp(8ar^). 
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5.3 Concentration of measure for linear combinations 
of independent random variables with log-concave 
tails 

Similarly as in [13], the proof of our main results will rely on induction with 
respect to d, the order of the chaos variable. The base of the induction, 
i.e. the case d = 1 was obtained in [H] by Gluskin and Kwapieh and later 
extended in [11] to linear combinations of independent symmetric random 
variables with log-concave tails with vector valued coefficients. Below we 
present the more general vector-valued version, together with some of its 
rather standard consequences, which provide the toolbox to be used in the 
proof. All the lemmas below contain the special case of Gaussian variables 
and reduce in this case to standard facts about the concentration and inte- 
grability for suprema of Gaussian processes. 

In the rest of this section we will use the assumptions and notation in- 
troduced in Section |2] specialized to the case oi d = 1. In particular we will 
suppress upper indices (see the remark after the definition of the functions 

m 

Lemma 5.9 (Theorem 1 in [H]). For any hounded set T C M" and all p > 2 
we have 



sup V] UXi 

^^^ i=l 



< 



sup V] UXi 

^^^ i=l 



1 



-|-sup<i ^tiXi: teT,xe M",^iVi(a;i) <p 



<L 



sup ^ tiXi 



teT 



i=l 



Thus, for any u > 0, 

n 

p(sup|^t,xJ > 



ieT 



i=l 



n 
\\\ l\^ 



tiXi 



+ sup I ^ UXi : t G T, a; e R", J^ Ni{xi) < u 



<e-". 



i=l 



i=l 
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Remark Using the notation of Section [21 we can write 

n n 

sup{ V Ux, ■.teT,xeW,y^ Mxi) <p} = sup ||t||^. p, 

which shows that the above lemma is indeed a strengthening of the case d = 1 
of Theorems 13.11 and 13.21 

Lemma 5.10. Consider arbitrary sets Ti, . . . , T^, C M" and let T = [J^^i Tj. 
Then 



n n 

EsupN tjXj <L( maxEsup \ tjXj 

n n 

+ sup{^(tj - Si)xi: t,s eT,x e W,^Ni{xi) < logm} 



i=l 



Proof. For m = 1 the theorem is obvious, so we will assume that m > 2. Let 
us fix arbitrary s E T. Since EXj = 0, we have 

n n n 

E sup y tiXi = E max sup > (tj — Sj)Xj < E max sup > (tj — Sj)Xj . 

Let y4 = sup{X]jLi(^i ~ Si)^^ : t E T,x E M", XliLi ^ii^i) ^ logm} and note 
that by the convexity of Ni and the definition of iVj, for any m > 1, 

iVj(x/u) < iV,(x)/u, (13) 

which implies that for u > 1, 



n n 

sup I ^(tj - Si)x, ■.tET,xeW,^ Ni{xi) < 2u logmj < 2uA. 
Thus by Lemma [5.91 and the union bound, for any u>l, 

n n 

P( max sup \y {ti — Si)Xi > L max E sup \y (tj — Si)Xj + LuA] 



- - 2" 
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which by integration by parts gives 

n n 

EsupN (tj — Sj)Xj <L( maxEsup \ (tj — Sj)Xj 



+ A 



i=l ' ""J i=l 

To finish the proof of the lemma it is therefore sufficient to show that for all 
j < m, 

n n 

(14) 



E sup I y](ti - Si)Xi <l(e sup V tiXi + a) . 
Let us choose any z ^ Tj. We have 



tGT, 



J i=l 



J 4=1 



Esup I V(ti - Si)Xi < Esup I V(ti - 2;,)X, + eI V(2;i - Si)X, 

n n 

<Esup\Y^{ti-Zi)Xi +l(Y2 

ti=T, I — V — 



J i=l 

n 



I Z?' 67 



1/2 



i=l 



< Esup ^(tj -2i)Xi 



teT, 



J «=i 



LA, 



(15) 



where in the first inequality we used the fact that variances of Xj's are 
bounded by a universal constants, whereas in the second one, the estimate 

(Er=i(^. - s.yyi' = sup{Er=i(^. - s^w. Er=i«? < u < (iog2)-M for 

m > 2, which is an easy consequence of flT3l) and the fact that Ni{u) = u^ 
for !«! < 1. 

Let us now notice that 



^ i=i 



Esup ^^{ti - Zi)Xi = Emax ( sup(V'(ti - Zi)Xi)+,snp(S^{ti - Zi)Xi)_) 

n n 

< Esup(V(ti - Zi)Xi)+ +Esup(V(ti - Zi)Xi)_ 

n n 

= 2Esup(^(t, - Zi)Xi)+ = 2Esup^(ti - Zi)Xi, 



t&T, 



J i=l 



ter. 



J j=i 



where in the second inequality we used the symmetry of Xj's and in the last 
one the fact that z eTj. 

The above inequality together with flTSl) proves flT^ and ends the proof 
of the lemma. D 
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Let us finish this section with a version of Lemma 15.101 in the special 
case of Gaussian variables. It improves on the inequality of Lemma \5.10\ 
as it asserts that the constant in front of maxj E sup^^^" Yl^=i ^i9i "^^J be 
taken to be equal to one. This result is again pretty standard and its proof 
can be found e.g. in [13] (see Lemma 3 therein). It is analogous to the 
argument presented above, but instead of Lemma 15.91 it uses the Gaussian 
concentration inequality. 



letT = [J"l^Tj CM". Then 



Lemma 5.11. Let gi, . . . , gn be independent standard Gaussian variables and 

J" 

V" tigi < max E sup V" tigi + L^/\og m sup (V'(sj-ti)^) . 

^ j<m teTi ^ s,t€T V ^ / 

4=1 ■' 1 = 1 ' 1 = 1 



6 Suprema of some Gaussian processes 

The main result of this section is Proposition 16. II below, which is a strength- 
ening of Theorem 3 of [TT] in the special case d = 3. Before stating the 
proposition we need some additional definitions. 

For a triple indexed matrix A = (aijk) and a set T C M" x M", let us 
define 

Aa(T) = sup I (^ ^ (^ ^ a,jk{xiyj - Xiyj)j j : (x, y), (x, y) E Tj 

k ij 

and 

4(A) = sup [(Xl(5Z^^Jfc^0 ) + ( 5Z ( 5Z ^^J'^^j) ) 
Proposition 6.1. For any p > 2 and any set T C (-B2 + y/pB") x (B2 + 

VpB^), 



E sup V] aijkXiyjgk < L ^Aa(T) + s^iA) + ^(y^a: 



2 ^ ' 



(-'J')e^~ ' V/^^— '' 



v^ 



Before we pass to the proof of Proposition l6.1l we will prove its counterpart 
for double-indexed matrices. This simpler result will be used in the proof of 
Proposition 16.11 
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Lemma 6.2. For any matrix B = {hij)ij<n, a > 1 and T C aB^, 

n 

Esup V h,x,g, < La^/2||S||;(' (||5||{i,2} A Ab{T)Y'^ + La^'^AsiT), 
<L(||E|||i,2} + aAB(T)). 

where Ab{T) = sup^^^,^^ (^ Y.]=i ( Er=i ^ii(^i - ^d ^ 



2\ 1/2 



Proof. Let us consider the process Z^ = J2^^i bijXiQj and the associated 
metric 



" " 2n1/2 



dz{x,x') = \\Z^- Z^>\\2 = (X^ (X^^iil^^i -^'i) 

j=l i=l 

Wehave Ab(T) = diam^.T. Since E(Er=i(E;=i %0)')'/' < v^l|5||{i,2}, 
by Corollary 15 -Sj we have for t G (0, 1], 

N{T,dz,t\\B\\{,^2}) <exp{Lat-'), 
so for e < II 5 II {1,2} , 

N{T,dz,e) <exp{L\\B\\{,^2}ae-'). 
By Dudley's bound (see [8] or e.g. Corollary 5.1.6 in [6]) we have 

/•As(T) 

EsupZ^<L/ ^log N{T,dz,e)de 

x&T Jo 

/.||B||{i,2}AAfl(r) 
<L / a'/^B\\\{l^e-'/'de 

+ L / a^/'^de 

i||B||{i,2}AAfl(T) 

=LaV2||i?||J/2^^(||5||^,^2} A As(T))V2 + LaV2A^(T). 
The second estimate of the lemma follows from the inequality I^Jxy < 

D 
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Lemma 6.3. For any matrix B = {bij)ij<n, O'^y T C B2+ y/pB'^ and p > 1, 

n 

Esup V" bijXiQj < L( ||S||{i,2} + v^Ab(T)), 

where A^ is as in Lemma \6. ^l 

Proof. Since nYJ!=i{Y.%iKi3ff'^ < ^\\B\\{i,2}, by Corollary ED (with 
a = y/p and t = l/{\^p)) there exist sets Ki C y/pB'^, i = 1,...,N < 
exp(Lp), such that 

TV 

and 

Ab{K,)<p''/^B\\{,,2}. (16) 

By Lemma [5.111 we have 



Esup> bijXiQj = ¥, max sup > hjXigj 

< maxE sup 2,^ij^i9j + -^\/log A^Ab(T) 

< max (E sup > hjXigj + E sup > hiXigj ) + Ly/pAB{T) 

< ||E|||i,2| + i:(||S||{i,2} + v^AB(ir,)) + Ly/^ABiT), 

(17) 



where in the last inequality we used Lemma 16.21 and the fact that 



E sup ^hijXiQj = E ^{^bijQjy < ||5|||i,2}- 

Inequalities (fT6|) and ( !T7|) imply the lemma. D 

For a triple indexed matrix A = {aijk)ij,k, let a^ be a norm on M" , given 
by 
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To simplify the notation we will write p^ for p^^. Note that 
where 

ijk 

We will also need a norm on R" x M" defined by 

jk i ik j 

The corresponding distance on M" x MJ^ will be denoted by pa- 
We will use the following consequences of Corollary 15.71 

Corollary 6.4. For any p > 1, any set T C {B^ + y/pB"^) x {B^ + y/pB'^) 
and any t G (0, 1], 

N{T, PA, t'P|||i,2,3} + tsl{A)) < exp(Lt-2 + L^r^). 

Proof. It is enough to notice that 

k ij k ij 

whereas 

V[,^iaA) + V^,yiaA) 

= sup E(V(Va,,,e,y,)2)V2+ sup E(V(Va,,fcX,e,)')'/' 

<V2 sup {y^{y^aijkXiff'^ + V2 sup (V(Va,,fc2/,)2)i/2 
{-,y)eT ^.^ . (..,j;)eT .^ ^. 

< 2y24(^)- 

The statement of the corollary follows now from Corollary 15.71 applied with 

d = 2. U 

Corollary 6.5. For any p>l, any set T C {Bl^ + y/pB'l) x (5J + y/pB'l) 
and any t G (0, 1], 

N{T,pA,t\\A\\^i,2,3}) <exp{Lt-^ + L^t-'). 
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Proof. Let {£^,8"^) be a standard exponential random vector with values in 
M" X M" = R'^''. We have 

Ea{S\S^)<2V2\\A\\{i,2,3}, 

hence the corollary follows from Corollary 15.71 with d = 1 and the fact that 
{B^ + ^B"^) X (5^ + ^B-^) C V25|" + 2^Bf". D 

To simplify the formulation of the next lemmas let us denote 
F^{T)=E sup y^y^aijkXiVjgk- 

Lemma 6.6. For p > 1 let {x,y) E {B^ + y/pB"^) x {B^ + ^/pB]^) and let 
T C (-B2 + y/pBi) X (i?2 + ^JpB"^). Then, for any I > 0, there exists a 
decomposition 

N 

T = [JTu 

1=1 

with N < exp(L2^']9), such that for all I < N , 



F^iix, y) + Ti) < F^iTi) + L5((x, y)). (18) 

and 

^a{Ti) < 2-W^hUA) + 2- VPII{i,2,3}. (19) 

Proof. We apply Corollary 16.41 with t = 2~'p~^'^, which gives us a partition 
of T into N < exp(L2^'p) sets, satisfying the required diameter bound ( TT9l) . 
Let B' = ib],), B^ = {hi) where 

3 i 

We have 

E(E(E^^^^^)')'''+^(E(E^'^^.)')''' 

k i k j 

< V2C£C£a,,,y,fYl' + V2C£C£a,,,x,ff/' 

ik j jk i 

= V2a{{x,y)), 
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therefore by Corollary 15.71 (with d = 1, a = ^/p and t = l/{Ly/p)), there 
exists a partition of T into at most e^^ sets Si such that for all I, 

We can intersect this partition with the previous one to obtain a partition 
of T into at most e*"^ ^ sets Ti, such that ( !T9|) holds and the above inequality 
is satisfied with T; instead of 5"^. 

Let TTi, 1T2 be the projections from M?"- = M" x M" onto the first and the 
second n coordinates respectively and note that 

ABi(vri(r;)) + AB2(7r2(T;)) 

< 2 sup \ij2ij2bUx[ - xiry/' + (E(E^i(^;- - yl)")'^" 

ix',y'),ix",y")eT ^^ ^ k j 

<^a{{x,y)). (20) 

By the equality EXlijfc aijkXiVjgk = we get for any /, 
F^{{x, y) + Ti) <F^(Ti) + E sup ^ (^ijkXiVjgk + E sup ^ (^ijkXiyjQk 
<F^^(T,) + L((^(5^a,,,x,)^)V2 + (E(E«^.^^^)')'^' 

jA; i ik j 

+ ^ABiiniiTi)) + ^A52(7r2(Tz))^ 
<Fi^(TO + M((x,y)), 

where in the second inequality we used the assumption T C (-B2 + a/P-B") x 
(-B2 + y/pB'i) and Lemma [6731 (applied to matrices B^^B"^) and in the last 
inequality the estimate ( l20l) . D 



Lemma 6.7. Lei S he a finite subset of (5^ + ^B'{) x (5J + ^B'l) of 
cardinaUty at least 2, such that S-S c{B^ + y/pB'l) x (5J + ^B^) . Then, 
for any I > 0, there exist finite sets Si C (-B2 + y/pBi) x (B2 + y/pB"^), and 
points (xi, yi) ^ Si i = 1, . . . ,N, such that 
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(i) 2 < A^ < exp(L22'p), 

(ii) S = [jllii^^,y^) + S^), S, - S, C S - S , j^S, < #5 - 1, 

(iii) AA(5,)<2-Vi^ll{i,2,3}, 
(iv) sl\A)<2-Y"'\\A\\{,,,^,^, 
(v) F^{{x,,y,) + S,) < Ff{S,) + Lsl{A). 
Proof. Corollary 16. 5[ applied with t = 2^'^^p^^/^, gives us a decomposition 

S = [Ji{xi,yi) +Ti), 

i=l 

where A^i < exp(L22'p), ixi,yi) G S and s^'(A) < 2-^-'^p-'^/'^\\A\\{i^2,3}- Since 
7^5* > 2 we can assume that A^^i > 2. We can also assume that the sets 
{xi, yi) + Tj are pairwise disjoint and nonempty, which implies that ^Ti < 
#S-1. 

Since Ti C S - {xi, y,) C (5^ + ^^5^)) x (5J + y/pB"^)), by Lemma iH 
it can be further decomposed into the union 

N2 

i=i 
with N2 < exp(L2^'p), where for all j, 

Aa(T,,) < 2-'-V'/'4l^) + 2-''-Vi^ll{i,2,3} < 2-Vi^ll{i,2,3} 

and such that 

FS{{x^, yi) + T,j) < F^{T,,) + LsliA). 

Notice that A^ = A^iA^2 < exp(L22'p), moreover Tij - Tij C S - S and 
sf'{A) < s^'iA) < 2-Vi^ll{i,2,3}. Since i^T^ < #r, < #5 - 1, to get the 
covering Si it is enough to renumerate the sets T^j. D 

We are now ready to prove Proposition 16 .![ 
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Proof of Proposition \6.1[ Define the numbers A^ , A; , Z > as 

Ao = Aa(T), Ao = sl{A) 
and 

A _ o2-2«^-l|| /I II A _ 9l-i„-l/2|| /I II 

^l — ^ P ||^||{1,2,3}, ^l — ^ P ||^||{1,2,3}- 

Assume first that T C ^[(5^ + ./pB"^) x {B^^ + y/pB"^)] and define for 

r, / G N, 

CT{r, I) = sup{Fi^(^) : S C {B^ + ^B^) x {Bl^ + ^B^), 

S-ScT-T,i^S<r, AAiS) < A,, ^(A) < A J. 

We have ct(1, /) = 0. Moreover 

Mr, 0) > sup{Fi^(^) ■.SCT,4^S< r}. (21) 

Notice now, that for any S satisfying the constraints from the definition of 
CT^r, I), by Lemma [6771 we can find a decomposotion S = IJi=i((^J5 Vi) + 'S'i), 
satisfying (i)-(v). Thus 



i 

< max F^ (Si) + Lsl{A) + L2^y/pAi 

i 

< crir -l,l + l) + LAi + L2^^Ai. 
Taking the supremum yields 

CT{r, I) < Crir - 1, / + 1) + LA, + L2^,/^Ai, 
which gives 



Mr, 0) < ct(1, r - 1) + L J](A, + 2'^Ai) 

1=0 

< l(^^Aa{T) + 4(A) + 2j9-i/lA|||i,2, 



To finish the proof it is now enough to notice that for T C (-B2 + \/pBi) x 

(i?2" + v^i?r), 

Ff(T) =4supcir(r,0). 
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Remark Note that the only place in the above argument where the quan- 
tities Aa{T) and s^(yl) appear is the first step of the induction, when we 
pass from / = to / = 1. All the other steps contribute just proper multiples 
of ||v4||{i_2,3} which are upper bounds on the parameters Aa_{S) and sf (A) of 
the set S considered there. D 



7 The partition theorem 

In this section we present partition results which will allow us to pass from 
the bounds on expectations of suprema of Gaussian processes developed so 
far to empirical processes involving general random variables with bounded 
fourth moments (in particular all random variables with log-concave tails). 

Lemma 7.1. Let a and a be two norms onMJ^ andM.'^"' respectively. For any 
p > I and T C (-83 + y/pB"^) x (Bl^ + y/pB'"^) we can find a decomposition 
T = |Jz=i(^' + i^hVi)) ^^^h ^ ^ exp(Lp), {xi,yi) G T such that for any 
ix,y),ix,y) G Ti 

a{x®y-x®y) < -¥.a{£^ ® S'^) 
p 

and 

a{x,y)<^Ea{S\S^). 
yP 

Proof. Let 

M := Ea{S^ ® £^) and M := Ea{£\£^). 

Define norm /3 on R^" by 

P{{x, y)) = Ea{x ® £^) + Ea{£^ ® y). 

By Corollary 15.71 with d = 1, a = y/p and t = p^^^"^ we can decompose 
T = lJi=i ^i i^ such a way that A^o < exp(Lp) and 

j3{x-x,y-y) <—^M, a{x - x,y - y) < —^M 
Vp y/P 

for any (x, y), (x, y) E Si. Let us choose any {xi, yi) e Si, put Si = Si- {xi,yi) 
and notice that 

V,'^ia,-^) = ^M + -^ sup P{ix,y))<-M. 
2y/p Ap 2VPi^,y)es, P 
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Hence again by Corollary 15.71 with t = p ^/^/2 we can decompose Si = 
Ufc=i^«,fc with Ni < exp{Lp) and a{x®y — x®y) < -M for all (x, y), {x,y) e 
Ti^k. ' " □ 

Theorem 7.2. For any p > 1 and T C (-Bg + a/P-B") x (5^ + ^/pB^) we can 
find a decomposition T = |Jj=i(^« + i^hVi)) '"^^^^ ^ ^ exp(Lp), {xi,yi) G T 
Sfic/i i/ifli for any Zk, 

E sup ^ aijkXtyjZkOk < ^[Yl ^lk4) ( XI 4fc) • 

Proof. Let 

and 

j,fc i i,k j 

Notice that by the Schwarz inequality 

1/4 / ,-^ \ 1/4 _ 

aAx 



<(E4fc4) /3(a;), a.(x,y)< (5^a^^.fc4) /3(x,y), (22) 

ijfc 

jU f ^ 2 7 IT fC 



ijk ijk 

where 



and 

Notice that (since the 4-th and 2-nd moments of chaoses generated by expo- 
nential variables are comparable) we have 



^/3{£^ ® £^) < {E/3\S^ ®£^)y^^<L(J2 « 



> 1/4 
2 ^ ' 



ijk 
ijk 



and 

warci c2^ ^ ^to54^c1 c2^^l/4 ^ r /" \^ ,, 

Hjk 



M^{S\S^) < {Ep\£\£^)y/^ < L[Y,ciV^'^ 



ijk 
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Hence by Lemma 1711 we may decompose T = |Jz=i(^' + i^hVi)) with 
N < exp(Lp), (x;, yi) G T in such a way that for any (x, y), (x, y) G TJ, 



/3(x ® y - X y) < — (^ ^ a|;,, j and /3(x, y) < j— (^^a 

ijk ^ ijk 



ijk 



The assertion follows by Proposition 16.11 and fl2^ . D 

Corollary 7.3. Let Zi, . . . , Zn be independent mean zero random variables. 
For any p > I there exists a decomposition (i?2 + ^JV^iY — \}i<n^^^IiV^ + 
Ti), where N < exp(Lp), {xi,yi) G (-B2 + a/P-S")^ and for every I, 



E sup J2 aijkXiyjZk < — = ( J] 4^) ^ ( 5Z 4^^^) 



(^,y)GT, ^ v^ ^ i,-fc 



ijfc '' jj'fc ijfc 



< — L4 ri 2 si. max Zt. 4. 

_ ^11 1111,2,3} ^ II /CII4 

Proof. It is enough to take the decomposition given by Theorem 17.21 and no- 
tice that by classical symmetrization inequalities and comparison of Gaussian 
and Rademacher averages, we have 

E sup y^^ajjkXjyjZk < 2E sup y^ ajjkXjyjZkSk 

< V27rE sup y^^ttijkXjyjZkgk, 

where Ek (resp. gk) are sequences of i.i.d Rademacher (resp. standard Gaus- 
sian) random variables, independent of the sequence Zk- D 



8 Proof of Theorem 13.2 



The case d = 1 of the theorem has been proved in [9], whereas the case d = 2 
in [12], thus it remains to prove the case d = 3. 

To simplify the notation we will write Xi,Yj,Zk instead of Xl_^, Xf^, Xf^ 
respectively. Applying the theorem in the (already known) case of chaoses 
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of order two, conditionally on Z^s yields 

e| J2 ^ijkXiYjZk f <^'' (e (IK 5^ aijkZ, 

ijk k 

k 

where Af' = (A^/)i<nj<2- Thus by Lemma ED we get 

Ea-ijkXiYjZk <L ( E ( V" ttijkZk ) + E ( V" a^j^Z, 



Af' \p 
{l,2},p/ 

{1}{2},P/ 



ijfc 



«J 



I 411-'^ -u II 411-^ 

l^ll{l,2}{3},p+ ll^lljl 



{1}{2}{3},P 



Af' 
{1}{2},P 

(23) 



We are therefore left with the problem of estimation of the expectations 
on the right hand side of the above inequality. This will be achieved in 
Lemmas 18.21 and 18.51 below. 

Let us first state a simple lemma which will be used repeatedly in the se- 
quel. It is an almost immediate consequence of the inequality (IT3l) . therefore 
we will skip its proof. 

Lemma 8.1. If J' is a partition of {1, 2, 3} and jj^J = r, then for any t>l, 
Plllp < ^1l^ll^,p- 

Lemma 8.2. Let M' = {N^)i<n,j<2- Then for any p > 2, 

m{Z^(^ijkZk)ij\\{l,2},p < -^(ll^ll{l,2,3},p+ ll^ll{l,2}{3},p)- 



Proof. By symmetry it is enough to prove that 

Esup{5^a,,fcZfca;,,: $^iV/((5^4)i/2) < p} 



(24) 



ijk 

llAT 



A^ 



<: T (W 4II-™ _|_ II 4||A' 

S -t>UI^II{l,2,3},p+ II^II{1 



2}{3},pJ- 



Moreover, we may and will assume that X^jfc'^ijfc i^ decreasing in 
Let us first notice that 

mfum. > 7(E(E4.)"' + ^(E E4J"'). 



(25) 



i<p jk 



i>p jk 
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Let Ap = {teW: Xli Nl{U) < p} and note that 

ijk i j 



i ^ j k 

Define 

Al = {teAp: \u\ <1}, 

Al = {teAp: \/ieN,i>i\fi i G (2^, 2'+V] ^{.U = Q or |ti| > Z^)}, 

Al = {te Ap:ti = Qioii< 2p, 

Vz6N,i>iV. z G (2'p, 2'+V] ^ (1 < |t^| < /' or U = 0)} 

and for m = 1,2, 3, 



i y j k 

Since Ap C A^ + A^ + A^, we liave 
Esnp{Y^a,^,ZkX,f. 5^iV,i((^x^_,.)^/') < p} < ^i + ^2 + ^3- (26) 

ijk i j 

Step 1 For |t| < 1, iV/(t) = t^ so 



j k i 



^ ^ E JE(E «^^'^-^'^)' + Ev^(E E(E «^^-^^' 

*^P \ 3 k i>P j k 



^,y" 



<i(E(E4.)"^ + v^(EE 






(^ijk) 



wfiere in tlie second inequality we used tlie fact tliat EZ^ < L. By ( p5|) this 
imphes that 

Si < Lmfi,2,3},p (27) 
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Step 2 We will now estimate 5*2 . To this end let us note that since for 
t > 1, Nlit) > |t|, for every t G A^, the set I{t) = supp t = {i < n: ti y^ 0}, 
satisfies 

#/(t) < 3p and V,eN,^>i #(/(t) H (2^, 2'+V]) < P/l'- 

Let us denote the family of subsets of {1, . . . , n} satisfying the above condi- 
tions by X. We have 

For each J G I let 5/ = conv{t G R" : supp tC I,J2i NKU) < p}. Then 



^2 < Emaxsup^ti /^(^ajjfeZfc)2. 

^ ' i y j k 

For each / G X, the set -B/ admits a 1/2-net Aii (with respect to the 
semi-norm induced by Bi) of cardinality at most 5*^ < 5^^. By standard 
approximation arguments we have 



sup ^ti J^(^aijfcZfe)2 < 2^sup ^tiJ^C^aijkZk) 
Therefore 



t^Bi , \l . ^ t&M: i y J k 



S2<E sup y^i^i./y^iy^ctiifc^, 



fcJ^ 



which by Lemma fS.lUl is up to a universal constant majorized by 



sup ^ tiE y^cy. (^ijkZ. 

t&UiexMi i y j k 



k)' 



+ sup sup ^tij^(^(^ijkrky 

teUiexMir: Zk^iirk)<Lp i V j k 



<LsnpU J2<'lk+\\Mn,2U3},Lp < ^(Pllu,2,3},p+ Pllu,2},{3},Lp)- 

Since for t > 1, ll^llji 2} {3} *» — ^^ll^llji 2| |3|p' ^^^ above inequality implies 
that 

52<^(Pllt[,2,3},p+Plla2},{3},p)- (28) 
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step 3 For |t| > 1, iV/(t) > t, so 






<L> min(/^,n)E max > /> (> aj^uZuY 

<Ly"mma\p)\p/Pf/^E max fyfVfVa^fcZfe 



^ 1/4 

i2\2^ 



1>1 "2'p<j<2'+ip ife 



%-fc; 



where in the last inequahty we used the comparison of the 4-th and the second 
moment of norms of hnear combinations of independent random variables 
with log-concave tails. 



Now, denote B = \/J2i>p J2ij '^Ijk ^^^ notice that by the assumption on 
monotonicity of J2jk ^Ijk^ ^^ have for i > p 

E2 ^ 

Therefore, we have 



jk ^ 



l>l i>2'p ^ ^' l>l ^ ^' 

which by fl25l) implies that 

S, < ^Pll^,2,3},p- (29) 

Inequalities fl26tl29p imply f l24|) and conclude the proof of the lemma. D 
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We will also need the following lemma, proven in [12] (Corollary 3, therein). 
We would like to remark in passing that the approach in [12] was different 
that in the present article and that the tools developed in the previous sec- 
tions could be used to give another proof of this lemma (in the spirit of the 
argument we provide below for Lemma 18. 5p . It seems a little bit more natural 
since Lemmas 18.21 and Lemma 18.51 play in the proof of Theorem 13.21 for d = 3 
a role analogous to role played by Lemma 18.31 in the proof of its counterpart 
for d = 2. 



Lemma 8.3 (Corollary 3 in [12]) • Consider any matrix A = {aij)ij<n 
let Ml = {N})i<n, W = {Ni),<nj<2. Then, for any p>2, 



and 



E 



( E«^.-^.) 11^,^^,, < ^(11^11^2}.+ PIIWW.)- 



Lemma 8.4. Let Af' = {N^i)i<n,j<2- Th 



en 



*j 



Af' 



{1}{2},P 



II V ' ' / i 

k<p 

Proof. Consider the norm on IRLpJ given by 

II (^1, . . . ,Zk 



< L\\A 



/ J "'ijk^k 
k<p 



«J 



\Af 
l{l}{2}{3},p- 

Af' 
{1}{2},P 



and let K be the unit ball of the dual norm || • ||^. Let M be a 1/2 net in 
K (with respect to || • ||*) of cardinality not larger than 3^^-! (M exists by 
standard volumetric arguments). Then for all z E IRLpJ^ 



|2;|| < 2 sup y 



UkZk- 



u£M 



k<p 



Thus 



E > aijkZk) <2Esup> UkZ, 

k<p k<p 



which by Lemma 15.101 does not exceed 

LsupiJ^UkZk-. ueM-M,J2^i{zk) <p} <Lsup{||2;||: J^^ki^k) < p} 

k<p k<p k<p 



LWA 



I{1}{2}{3}- 



D 
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Lemma 8.5. Let M' = (A^/)i<raj<2- Then for any p >2, 

k 
< -^(^ll^ll{l,2,3},p+ ll^ll{l}{2,3},p + ll^ll{2}{l,3},p + ll^ll{l}{2}{3},pj- (^0) 

Proof. Let us first notice that it's enough to prove the formally weaker esti- 
mate 

^11 (/ ,'^ufc^fc)ij|||l|,|2},p 
k 

< Li^y/p\\A\\^i^2,3} + Pll{l}{2,3},p + Pll{2}{l,3},p + ll^ll{l}{2}{3},pj- (31) 

Indeed, suppose that the above inequality holds for all triple-indexed 
matrices, and assume additionaly (without loss of generality) that ^ ■ • a^^-^ 
decreases in k. We have 

JE||(2^aijfc^fc)iill{i},{2},p < ^Wiy ,Q»jfc^fc)»ill{i|,|2|.p + J^II(/ .Q»ifc^fc)»ill|i|,|2},p- 

k k<p k>p 

By Lemma [8.41 we have 

^\\i2^(^ijkZk)ij\\{l}{2},p < -^ll^ll{l}{2}{3},p- 
k<p 

Moreover, by our assumption 

k>p k>x 

Monotonicity of J^a ^Ijk implies that 

^ „2 . Y^ j-2 ^„|j.|^iT^II4llAA 

2,3},p; 



k>p k>p ij JSPa.J7^{{i,2.3}} 

J/{{1,2},{3}} 

v^(EE<^)'^' ^ supiE^fe /E4-^^ J2^i<p^ \tk\ < 1} < Pii{(,2 



k>p ij 



which together with the previous three inequalities proves (|30|) . 
We will now prove ( 13T|) . To this end let us denote 



A^ = {tGM": Y.N^,{U)<p}, J = 1,2,3. 



i=l 
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Since N-(t) > \t\ for t > 1, it is easy to see that Aj^ C y/pB2 +pB^. Hence, 
by Corollary 17.31 and the fact that EZ^ < L, there exists a partition 



KN 



with N < exp(Lp), (x , y ) E Ap x Ap, such that 

maxE sup S^aijkXiyjZk < L^\\A\\{i^2,3}- (32) 

Now, by Lemma [5.101 
E sup ^aijkXiUjZk 

< maxE sup V'ajjfca^iyj^fe + 2 sup y^ ajjkXjyjZk 



< maxE sup ^.'^'i-jk^iVj^k + -^ 



where in the second inequality we used the fact that A^^ C LA^. 

Thus it remains to estimate raaXl<N^svip(^^y^^(^^lyl^_^_rp^J2ijk'^^jk^^yj^k■ 
Denote by 7ri(T), 7r2(T) respectively projections of T/ onto the first n and 
the last n coordinates and let Mj = {N:l)i<n, j = 1, 2. We have 

E sup ^aijkXiUjZk 
<E sup y2^ijk^iyjZk + ^ sup y^aijkXiUjZk + E sup y^aijkX^yjZk 

< Lv^||A|||i,2,3} + 2\\{J2aijkX%)j\\';^^^^ + 2||(^a,,,y;.Zfc),||^^j^^ 

ik jk 

< Lv^||A||{i_2,3} + ^||^||{l}{2,3},p + ^Pll{2}{l,3},p + ^Pll{l}{2}{3},p' 

where the second inequality follows from fl32|) and the fact that t^j{Ti) C LA^^, 
and the third inequality from Lemma [8.31 (applied to Z^ instead of Yj, which 
corresponds to an appropriate permutation of the array Nl) . This proves 
( 13T]) and ends the proof of the lemma. D 
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Conclusion of the proof of Theorem \3.S[ By lemmas 18.21 and 18. 5[ the right 
hand side of (1251) does not exceed 

/ . U(^ijk)\\j,p, 

JeP-i 
which ends the proof. D 

9 Proof of Theorem 13.4 



In this section we restrict our attention to the special case of symmetric 
exponential variables and consider polynomial chaoses of arbitrary order. 
For exponential variables, the function N^{t) = t, which allows us to replace 
quantities ||(ai)||j^p by simpler quantities. 

Proposition 9.1. If for all i < n,j < d, N^i{t) = t, then for every J = 
{ Ji, . . .,Jk} e Pd and every p>2, 

' ^ Ire 

leQiJ) 
<ll(ai)lll<^. E P*^^^^^-*^^^/^max||(aOij5U,,) 

where Q{J) = {I C {l,...,d}: Vi<fc#(/^ H J^) < 1} and S{J,I) is the 
partition of I obtained from J by removing from the sets Ji all the elements 
of P. 

Proof. It is enough to prove that 

^"^(pmax||(ai)i2,...,,J|{2,...,d} + VP||(ai)||{i,...,d}j 
<sup{E«ia;i: E"^^^(( E ^^)^^^ E ^^) -P^ 
<^(pmax||(ai)i2,...,ij|{2,...,d} + v^||(ai)||{i,...,d}j. 

The proposition follows easily by an iterative application of this inequality. 
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To prove the above inequality it suffices to notice that 

ii 12,. ..,id 

={zny\- ^mind^;^!,^^) <p,Vi, ^ yl < 1} 

i i2,...,id 

and 

i^B^) U (pB^) c{zeR^: ^min(|^,U2) < p} c ^B^ + pB^. 

i 

We will leave the details to the reader. D 

For a nonempty set I, let us denote by Pj the set of all partitions of / 
into pairwise disjoint, nonempty sets. In particular P{i,...,d} = Pd, P% = {0}- 
The above proposition yields the following 

Corollary 9.2. If for all i < n,j < d, Nj{t) = t, then for every p>2, 
/c{i,...,4 J'eP/ '^'^ 

jGPd /C{l,...,d} JePi '^'^ 

From the above corollary and Theorem 13.11 it follows that to prove The- 
orem [231 it is enough to demonstrate the following 

Proposition 9.3. If{X^)i<n.j<d o,re independent symmetric exponential ran- 
dom variables, then for every p > 2, 

i /C{l,...,d} JePj 

The proof of Proposition 19.31 will be based on induction with respect to 
d. It will require several additional lemmas. Throughout the rest of this sec- 
tion we will assume that {X^)i<nj<d are independent symmetric exponential 
random variables. 
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Lemma 9.4. For any d = 2,3, . . ., 
E||(^aiXfji^^j,||{i}...{d-i} 

id 

j&Pd j'^Pd-i 

We will need the following technical fact. 

Lemma 9.5. Let Y.^ he independent standard symmetric exponential vari- 
ables and Y^ = gf, Y^ = giCji, where gi,gi are i.i.d J\f{0, 1) variables and 
Ei - i.i.d Rademacher variables independent of Y- . Then for any normed 
space E and any vectors vi, . . . ,Vn ^ E the quantities 



E\\Y,Vie,Y, 



U) 



J = 1,2,3, 



are comparable up to universal multiplicative factors. 

Proof. Since we can symmetrize all variables, and by the contraction principle 
and Jensen's inequality 

EWy^ViEilY^^'^l >cE\\y^Vie 



it is enough to show that one can define copies of the variables Y^ (which 
we will identify with the variables) on a common probability space in such a 
way that for any j, /c = 1, 2, 3, 

This is possible by using the inverse of the distribution function, since 

P(|r«|>t) = e^*, 

n 



and 
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The proof of Lemma [9.41 will be based on a conditional application of the 
following result from [13] (see pQ for a similar approach in the context of 
moment inequalities for [/-statistics). 

Lemma 9.6 ([I3], Theorem 2). For any p > 2, 

id JdVi, 



Proof of Lemma \9.4\ Lemmas 19.51 and 19.61 give 

id id 

<L,Y.p^'^*^-'^"ma:g^Mj- (34) 

J(^Pd 

Take J e Pa oi the form J = {I^U {d}, . . . , 4} where {Ji, . . . , 4} \ {0} e 
Pd-i- We have 



E\\{a,g,jfj = E ^ sup^ E^IE( E "^ H 

W^l^ \\2<l,j=2,...,k i^ i^^ i(i-iu{d})c i=2 



k 2 



1 



<||(aO||^ + E sup E(^l-1)E( E ^ilK,)'- 

Since "^Qi^ = 1, standard symmetrization arguments applied to the second 
term on the right hand side give 

E||(ai<7jl|^<l|(ai)l|^ + 2E sup E^^XE( E ^^114,) 

ll^i^J|2<l,i=2,...,fc i^ i^^ i(/iu{d})c i=2 

(35) 
< \\{ai)\\j + LE sup E^^d^^'^Ei E "ill^i 

Il^i^^.ll2<lj=2,...,fc i^ i,^ Hl^uid))- i=2 

where in the second inequality we used again Lemma 19. 5[ Let now 



M = max sup 






xi l|2<l,i=2,...,fc\ i,^ i(,^' 



E( E ^iYl^ii.y = '^.^^\\(^i)Hd}c\\iu...,h 



J{d})c J-2 
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and for fixed Qi^ consider functions ifk'- IR — )■ K, given by the formula 



for \t\ < \gijM, 



[g^,M/2 for \t\>\g.,\M. 

We have |v^i^(i)| = l^l/ds'jdl^) < 1 foi' 1^1 ^ \9id\^y moreover yjj^ is constant 
for t > \gi^\M, so (pi^ is 1-Lipschitz. Thus, by the contraction principle (see 
Corollary 3.17 in |15]). 



Eg sup \^9i,^i,[9i,[^[ Yl ^'H^i/, 

\\xl h<l,j=2,...,k i, i^^ Hl,uW)c 3=2 



2\ 1/2 



<4E^ ^, sup IXl^^d^^'^iZli 5Z "'H 



which implies that 
E^ sup 



a^i. 



2\ 1/2 



lUJ ||2<l,l=2,...,fc ,• 
J 

< 8ME3 sup 



ill \Hu{d}r i=2 



(36) 



(37) 



a;i^J|2<l,i-2,...,fc i^ ij^ i(I-^uid})'= i=2 



2\ 1/2 



Denote T = Y[i=2^Hj, where Bh^ is the unit ball of the Hilbert space 



(g);g^, M". For t e T, t = {xl)'^^2 let 



i/i i(/iu{d})= i=2 



1/2 



«d 



Then, conditionally on gi^, (Xt)^^^ is a Gaussian process. It induces a metric 
on T given by 

dx{t,s) = \\Xt -X^||2. 
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More explicitly if t = {xf^ )'j=2j ^ — ivlj )i=2; then 
dx{t,sf 

£E4E( E ".(rK.-n^;,))'. 

«d i/i i(^iu{d})c i=2 i=2 

where to obtain the last inequality for each fixed id we used the triangle in- 
equality in the space ^2({1, • • • , n}^^) for vectors aij = ^j ^ Oi n}=2 -^i/ 

and6i,^=Ei(,^,(,„.«in'=2l/v 

Now, the right-hand side above is equal to dj^{t, s) = \\Xt — Xs\\2, where 
{^t)teT is a (conditionally) Gaussian process defined as 

k 

i/iu{d} i(/iu{d})c i=2 

where t = (x;^ )^^2 ^-nd (^i^ u{d})i/ utd) ^^ ^^ array of i.i.d. standard Gaussian 
variables independent oi gi^. 

Thus by the Slepian lemma we have 

Kg sup Xt < E,g sup Xt- 

teT teT 

Moreover, since G T, Xq = and T is symmetric with respect to the origin, 
we have 

Esup|Xt| = Emax(supX(, sup(— X()) < EsupXj + Esup(— X^) =2supXt. 
t£T teT teT teT teT teT 

Thus, we have 

k 

^9 , sup |l]^id^id(l]( J2 ^H 

\\xl^^h<l,j=2,...,k i^ i^^ i(/iu{d})<= i=2 

fc 

<2E~g ^ sup 5^ ^i,iu{d} Zl ^^d^iJI^ 

\\xl^^\\2<l,j=2,...,ki^^^^^^ i{/iu{d})<= i=2 

KePd 
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2\ 1/2 



where the last inequahty follows from another application of Lemma 19. 6[ 
conditionally on gi^. Going now back to (I5H]) and (1371) . we obtain that for all 
e e (0, 1) and all J = {IiU {d}, h, . . . , h} G Pa, 



+ L, /p(2+'=-<^)/2 max II (aOi^.j. b' / 5^ p(i+#'=-^)/2E|| (ai^, J Ik 






<p^'^'-'^/ma,)\\j 



+ W+(i+#^'-'^)/2e-i max II (aOi,,,. l^ + sL, V p('^*'^"^y'E\\ {a,g,,) |k, 

I'd •^■^^ 

where J' = {/i,...,/^} \ {0}. Summing the above inequalities over all 
J & Pd and choosing e to be a sufficiently small number depending on d, we 
get 

J&Pd J(^Pd 



+ L, E p'^^'^'-'^"^^A\{a^\dy\\j- 



Together with flM|) this ends the proof of the lemma. D 

To prove Proposition 19.31 we will also use a technical fact proved in [1] in 
greater generality (see Lemma 5 therein). 

Lemma 9.7. For a > and arbitrary nonnegative numbers ri^^,,,^i^ andp > 1 
we have 



p°^E<^^>"' 



p"^ max rf + \J p*^^ niax( V^ ri)^ 



/C{l,...,d} '^ ijc 



Proof of Proposition \9.3[ The argument is similar to the proof of Theorem 6 
in [1] therefore we will only sketch the main steps. 

Since for p = 2 the proposition is trivial (recall that (||(a.i)||{i,...,d} = 
(^ja?)^/^), we will assume that p > 2. 
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Let us first note that to prove the proposition it is enough to show that 

i I(l{l,...,d} j£Pi ijc 

Indeed, for fixed / let us apply Lemma 19.71 (with p/2 instead of p, jj^P 
instead of d and r-^^^ = ||(ai)ij||j-). We get 

ijc 

< L^#,.(j>/2)°*'^(max||(aOi,r^+ $^(p/2)#'^^/^-"^/2max(5^ II (ai)^!^^/^ 

Note that we have Zli.c^j IK^^i)!/!!^ < ^ijc ^? = ll(«i)ijc||{jc} and that 
p#J+i/2 j^g^-j^.^ II (ai)i_,c II {jc} appears among the summands on the right hand 
side of fl33l) . Thus the above inequality with a sufficiently large (depending 
only on d) implies that the right hand side of fj38|) is majorized by the p-th 
power of the right hand side of the inequality asserted in the proposition (we 
use the fact that if a depends only on d then p"*-^'' < L^). 

It remains to prove (l38l) . We will proceed by induction on d. For c? = 1, 
the proposition (which is stronger than (138|) for c? = 1) is a special case of 
Theorem 13.21 (it also follows from the Gluskin-Kwapieh estimate). 

Let us thus assume that (1551) holds for chaoses of order at most d — 1. We 
will show that then it holds for chaoses of order d. Applying the induction 
assumption conditionally on {Xf)i together with the Fubini theorem and 
Lemma 15.101 we obtain 

i 

/C{l,...,d-l}>7eP/ i{i,...,d-i}\l id 

<l: E y. f'"'"'*'^*"'' E mC£^:xtMjr 

/C{l,...,d-l}^eP/ i{i,...,d-i}\l id 

I C{1,.. . ,d} J ^Pl h'^ 

By Lemma 19.41 the first sum on the right hand side above is majorized by 
the second one, which proves fl38|l . D 



44 



10 Appendix 

Proof of Proposition li.H Note that 

d n 

/ . / . «ii,...,j,^n ■ ■ ■ ^ij = 2^ -f^n,...,Jd(^n) • • • ) ^id)) 

jf=0 ii,...,ij=l 



l<il,...,i^<n 
pair\vise distinct 



where 



-'^ii,...,id\.'^iy • • • ) "^d 



1 "^ 

)4E 



(n-rf)! 



(i! -^ — ' [n — 1 ,. 



Z^ '^V(i),-,i 



X 



■U) 



7r(l) ■ ■ ■ Xtt{j) 



and S'd denotes the set of all permutations of the set {1, . . . ,d}. Note that 
for every n E Sd, hi^^^^,„i^^^^{x^(i), . . .,x^^d)) = hi^^,„^i^{xi, . . .,Xd). Therefore 
by general decoupling inequalities for [/-statistics (see f5] or Theorem 3.1.1. 
in [6j), we have 



j=0 ii,...,ij=l 



> 



/ . Hi^,...,iai^l^^- ■ ■ ,^, 



l<il,...,i^<n 
pair^vise distinct 



The right hand side of the above inequality is equal to 

d ^ n 

j=0 \j) l<ri<...<rj<dii,...,ij=l 

(we used the symmetry of the coefficients a^^ ■,). Since (again by decou- 
pling) for any 1 < ri < . . . < Vj < d, 






> 



Z2 K,...,ij^n---^i: 



il,...,ij=l 



to finish the proof it is enough to show that 



HE E E '^ <,x:!---xi 

j=0 l<ri<...<rj<dii,...,ij=l 



P 



(39) 



j=0 l<ri<...<rj<d ii,...,ij=l 
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for any coefficients 6^ ^ . 

We will proceed by induction on d. For d = 0, f l39|) read as Ld\b^\ > \b^\, 
which is obviously true. Let us thus assume that fl39l) holds for all numbers 
smaller than d. Consider any set k G {1,. . . ,d}. By the Fubini theorem, 
Jensen's inequality (applied to the integration with respect to (Xf ),) and 
the assumption that X^ has mean zero, we get 



j=0 l<ri<...<rj<dii,...,ij = l 
d— 1 n 

a||E E E '^. 






j = l<ri<...<rj<d Ji,...,ij=l 



which by the induction assumption is greater than or equal to 

d— 1 n 

^d^z2 E II E K,...,i,^ii - - - ^l 

Thus, since k in the above inequality is arbitrary, we get 

j=0 l<ri<...<rj<dii,...,ij = l 
d—1 n 

>y y II y v, ,xr---x 

j=0 l<ri<...<r-j<d i\,...;ij=l 

To finish the proof of (l39l) it is now enough to notice that for any norm || • ||, 
vectors x,y and number K > Q, \\x\\ < K\\x + y\\ implies that ||x|| + \\y\\ < 
{2K + l)||x + y\\. This ends the proof of the proposition. D 
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